An Evaluation of IntelliMetricTM Essay Scoring System Using Responses to GMAT® AWA Prompts
نویسندگان
چکیده
The Graduate Management Admission Council® (GMAC®) has long benefited from advances in automated essay scoring. When GMAC® adopted ETS® e-rater® in 1999, the Council’s flagship product, the Graduate Management Admission Test® (GMAT®), became the first large-scale assessment to incorporate automated essay scoring. The change was controversial at the time (Iowa State Daily, 1999; Calfee, 2000). Though some may still find it controversial, automated essay scoring is now widely accepted as a tool to compliment, but not replace, expert human raters.
منابع مشابه
Automated Evaluation of Essays and Short Answers
Essay questions designed to measure writing ability, along with open-ended questions requiring short answers, are highly-valued components of effective assessment programs, but the expense and logistics of scoring them reliably often present a barrier to their use. Extensive research and development efforts at Educational Testing Service (ETS) over the past several years (see http://www.ets.org...
متن کاملAutomated Essay Scoring for Nonnative English Speakers
The e-rater system 1 , an automated essay scoring system, developed at Educational Testing Service (ETS), is currently being used to score essay responses on the Graduate Management Admissions Test (GMAT). The average agreement between human readers, and between independent human readers and e-rater is approximately 92%. There is much interest in the larger writing community in examining the sy...
متن کاملAutomated Scoring Using A Hybrid Feature Identification Technique
This study exploits statistical redundancy inherent in natural language to automatically predict scores for essays. We use a hybrid feature identification method, including syntactic structure analysis, rhetorical structure analysis, and topical analysis, to score essay responses from test-takers of the Graduate Management Admissions Test (GMAT) and the Test of Written English (TWE). For each e...
متن کاملAutomatic scoring of short handwritten essays in reading comprehension tests
Reading comprehension is largely tested in schools using handwritten responses. The paper describes computational methods of scoring such responses using handwriting recognition and automatic essay scoring technologies. The goal is to assign to each handwritten response a score which is comparable to that of a human scorer even though machine handwriting recognition methods have high transcript...
متن کاملThe GMAT Analytical Writing Assessment : Opportunitw or Threat for Management Communication ?
Instituted as a regular part of the GMAT in October 1994, the Analytical Writing Assessment (AWA) has the potential to serve as a diagnostic tool in MBA programs. This article describes the new test and reviews the uses of the AWA scores and essays that have significant ramifications for management communication. It concludes by suggesting why it is vital for communication instructors to become...
متن کامل